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ABSTRACT 



A force feedback interface and method including an actuator 
in a non-primary axis or degree of freedom. The force 
feedback interface device is connected to a host computer 
that implements a host application program or graphical 
environment. The interface device includes a user manipu- 
latable object, a sensor for detecting movement of the user 
object, and an actuator to apply output forces to the user 
object. The actuator outputs a linear force on the user object 
in non-primary linear axis or degree of freedom that is not 
used to control a graphical object or entity implemented by 
the host computer, and movement in the non-primary degree 
of freedom is preferably not sensed by sensors. The axis 
extends through the user object, and there are preferably no 
other actuators in the device, thus allowing the force feed- 
back device to be very cost effective. Force sensations such 
as a jolt, vibration, a constant force, and a texture force can 
be output on the user object with the actuator. The force 
sensations can be output in a direction perpendicular to a 
planar degree of freedom, radial to spherical degree of 
freedom, and/or along a lengthwise axis of the user object. 

17 Claims, 5 Drawing Sheets 
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LOW COST FORCE FEEDBACK DEVICE consumer. A large pan of this manufacturing expense is due 

WITH ACTUATOR FOR NON-PRIMARY to the inclusion of multiple actuators and corresponding 

AXIS control electronics in the force feedback device. In addition, 

high quality transmission components such as linkages and 

This application is continuation of Ser. No .09/ 103,281, 5 bearings must be provided to accurately transmit forces from 

filed Jun. 23, 1998, now U.S. Pal. No. 6,088,019. the actuators to the user manipulandum and to allow accu- 
rate sensing of the motion of the user object. These com- 

BACKGROUND OF THE INVENTION ponents are complex and require greater precision in their 

xk^ , • t r manufacture than many of the other components in an 

lne present invention relates generally to interface . t f , . , * - . ,, *_ 4 e . 

Am ,; m *. „ • , , . , - ... .10 interface device, and thus further add to the cost of the 

devices for allowing humans to interface with computer , r . e r . Jt , j . 

systems, and more particularly to computer interface devices ^\ ICC \ need therefore exi f for a for( 5 fee f ack de f vice 

that allow the user to provide input to computer systems and l f hat j S lo * er 1 " cost manufacture yet offers the user force 

allow computer systems to provide force feedback to the feedback 10 enhance lhe inleracl ™ wtlh a <» m P uler a PP h * 

cal,on ' 

A computer system m typical usage by a user displays a SUMMARY OF THE INVENTION 
visual environment on a display output device. Using an 

interface device, the user can interact with the displayed The present invention is directed to a low-cost force 

environment to perform functions and tasks on the feedback interface which provides a linear actuator along a 

computer, such as playing a game, experiencing a simulation 20 non-primary axis or degree of freedom. This configuration 

or virtual reality environment, using a computer aided can P^vide a simpler, lower cost force feedback device, 

design system, operating a graphical user interface (GUI), especially when motion in the non-primary axis is not 

etc. Common human-computer interface devices used for sensed and no other actuators are used, 

such interaction include a joystick, mouse, trackball, steer- More specifically, the present invention relates to a force 

ing wheel, stylus, tablet, pressure -sensitive sphere, or the 2 s feedback interface device that is coupled to a host computer 

like, that is connected to the computer system controlling the system which implements a host application program. The 

displayed environment. Typically, the computer updates the interface device includes a user manipulatable object, such 

environment in response to the user's manipulation of a as a mouse or joystick, contacted by a user and movable in 

user-manipulatable physical object such as a joystick handle physical space in at least one primary degree of freedom. At 

or mouse, and provides visual and audio feedback to the user 30 least one sensor detects the movement of the user object in 

utilizing the display screen and audio speakers. The com- the degree of freedom and outputs sensor signals represen- 

puter senses the user's manipulation of the user object tative of the movement. An actuator is coupled to the user 

through sensors provided on the interface device that send manipulatable object and applies a linear output force along 

locative signals to the computer. For example, the computer a non-primary axis extending through the user manipulat- 

displays a cursor or other graphical object in a graphical 35 able object, where the force is output in a degree of freedom 

environment, where the location of the cursor is responsive not sensed by the sensor. Preferably, there are no other 

to the motion of the user object. actuators in the device. Force sensations such as a jolt, 

In some interface devices, tactile and/or haptic feedback vibration, a constant force, and a texture force can be output 

is also provided to the user, more generally known as "force 00 lne user object with the actuator, 

feedback." These types of interface devices can provide 40 In preferred embodiments, the actuator outputs the force 

physical sensations which arc felt by the user manipulating directly on the user manipulatable object, such that no 

a user manipulatable object of the interface device. For transmission system is required to be provided between the 

example, the Force -FX joystick controller from CI I actuator and the user manipulatable object, thus greatly 

Products, Inc. and Immersion Corporation may be connected reducing the cost of the device. In addition, the actuator can 

to a computer and provides forces in the degrees of freedom 45 include a physical spring or other spring device for biasing 

of motion of the joystick to a user of the controller. One or said at least a portion of the user manipulatable object 

more motors or other actuators are coupled to the joystick toward an extended position. The actuator can take a variety 

and are connected to the controlling computer system. The of forms, such as a linear voice coil actuator, a linear 

computer system controls forces on the joystick in conjunc- solenoid, or a voice magnet. A microprocessor local to the 

lion and coordinated with displayed events and interactions 50 interface device can be provided to receive host commands 

by sending control signals or commands to the actuators. from the host computer and output force signals to the 

The computer system can thus convey physical force sen- actuator for controlling the output force on the user object, 

sations to the user in conjunction with other supplied feed- The microprocessor can receive sensor signals from the 

back as the user is grasping or contacting the joystick or sensors and report locative data to the host computer indica- 

othcr object of the interface device. For example, when the 55 live of the movement of the user object. Alternatively, a 

user moves the manipulatable object and causes a displayed sensor can be coupled to the actuator to determine a position 

cursor to interact with a different displayed graphical object, of the user manipulatable object in the degree of freedom of 

the computer can issue a command that causes the actuator the actuator. 

to output a force on the user object, conveying a feel i n one embodiment in which the user manipulatable 

sensation to the user. Other force feedback controllers 60 object is moved in a planar degree of freedom, the output 

include a force feedback mouse that provides forces in the force of the actuator can be provided in a direction approxi- 

degrees of freedom of motion of the mouse, and a steering mately perpendicular to the plane of motion. For example, in 

wheel controller outputting forces in the rotary degree of a mouse embodiment, the force is applied about perpendicu- 

freedom of the wheel. lariy to the planar mouse workspace and is applied to an 

One problem with current force feedback controllers in 65 entire portion of the mouse thai is grasped or rested upon by 

the home consumer market is the high manufacturing cost of the user's hand. In a particular mouse embodiment, the 

such devices, which makes the devices expensive for the actuator is coupled to a housing of the mouse and moves a 
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portion of the housing in the perpendicular direction. Such FIG. 2 is a side elevational view of a linear voice coil 

a moveable portion of the housing can be a cover portion of actuator suitable for use with the present invention; 

the housing that is movably coupled to a base portion of the FIG. 3 is a perspective view of a joystick embodiment of 

housing for example by . hinge, where the cover port.or.ts , he fofcc fcedback dcvicc f h invention; 

moved by the actuator with respect to the base portion. The 5 . 

output force can be correlated with a graphical representa- FIG - 4 151 a Slde elevational view of a mouse embodiment 

lion displayed by the host computer, where a position of the of lne force feedback device of the present invention; 

mouse in the planar workspace corresponds with a position FIG. 5 is a perspective view of a steering wheel embodi- 

of a cursor displayed in the graphical representation. For ment of the force feedback device of the present invention; 

example, a jolt force can be output when the mouse crosses lQ FIG. 6 is a side elevational view of a stylus embodiment 

a boundary of a window or icon. Or, the output force can be of the force feedback device of the m mvention; and 

correlated with an elevation of a portion of a 3-D graphical ^ T ,_, m . 

representation having different elevations on which the FIG ' 7 1S a Sldc elevational view of a different stylus 

cursor is displayed. In a different embodiment, the user embodiment of the force feedback device of FIG. 6. 
manipulatable object can be a stylus; or a wheel, such as a 

steering wheel, that rotates in the single plane, and where the 15 DETAILED DESCRIPTION OF PREFERRED 

axis extends approximately through a center of the wheel. EMBODIMENTS 

In a different embodiment, the user manipulatable object FIG. 1 is a block diagram illustrating a force feedback 

is moved in two sensed rotary degrees of freedom with interface system 10 of the present invention controlled by a 

respect to a ground, where the degrees of freedom approxi- Q0St computer system . Interface system 10 mc ludes a host 

mately define a portion of a surface of a sphere. For 20 cornpuler systcm 12 and an interface device 14. 

example, the user manipulatable object can be at least a ,, . 

portion of a joystick handle that is typically moved in such Host com P ut er system 12 is preferably a personal 

rotary degrees of freedom. The actuator of the device applies computer, such as a Pentium-class (IBM -compatible) PC or 

an output force in a linear degree of freedom that is Macintosh personal computer, or a workstation, such as a 

approximately radial to the sphere, where preferably no 25 SUN or Silicon Graphics workstation. For example, the host 

force is output in the two primary sensed degrees of free- computer system can a personal computer which operates 

dom. The force is applied along a lengthwise axis of the user under the Windows, MS-DOS, or Linux operating systems, 

manipulatable object. Alternatively, host computer system 12 can be one of a 

In another embodiment, the user manipulatable object is variety of home video game systems commonly connected 

movable in physical space in a plurality of degrees of 30 to a television set, such as systems available from Nintendo, 

freedom with respect to a ground, and a linear actuator Sega, or Sony. In other embodiments, home computer sys- 

applies a linear output force only along a lengthwise axis of tem 12 can be a television "set top box" or a "network 

the user manipulatable object and not in the plurality of computer" which can be used, for example, to provide 

degrees of freedom. One such embodiment provides a stylus interactive computer functions to users over networks, or 

as a user manipulatable object, where the sensor can be ot her appliance having computer functions, 

included in a tablet which is contacted by the stylus. In one »...■-.._,. 

embodiment, the stylus includes a rigid tip for contact with . ,r ! lhe desc " bed embodiment, host computer system 12 
the tablet, where the actuator outputs a force to move a body im P le ments a host application program with which a user 22 
portion of the stylus relative to a tip portion of the stylus. In 15 interacting via peripherals and interface device 14. For 
a different stylus embodiment, the stylus includes a ball in example, the host application program can be a video game, 
a tip of the stylus, where the ball rotates in place when the 40 web browser, scientific analysis program, operating system, 
stylus is moved across a surface. The actuator can force a graphical user interface, medical simulation, or other appli- 
brake pad against the ball to output a resistive force on the cation program that utilizes force feedback. Typically, the 
stylus. host application provides images to be displayed on a 
The present invention advantageously provides a force display output device, as described below, and/or other 
feedback device that is significantly lower in cost than other 45 feedback, such as auditory signals. The application program 
types of force feedback devices and is thus quite suitable for and nost computer provide a graphical environment with 
home consumer applications. A single actuator can be pro- which the user may interact. For example, the graphical 
vided that directly applies force to the user manipulatable environment may display graphical objects, such as icons, 
object, thus saving cost by the elimination of multiple windows, or 3-D objects; or entities, such as a player- 
actuators and complex force transmission and control sys- 50 controlled simulated vehicle or character, 
terns. The actuator does not output force in a main sensed Host computer system 12 preferably includes a host 
degree of freedom of the device, thus allowing sensors to microprocessor 16, a clock 18, a display screen 20, and an 
read the position of the user object without substantial audio output device 21. The host computer also includes 
interference from forces and also simplifying the control of ome r well known components, such as random access 
output forces. Furthermore, the actuator of the present 55 memory (RAM), read-only memory (ROM), and input/ 
invention can provide a variety of different types of force output (I/O) electronics (not shown). Host microprocessor 
sensations to enhance the user's experience and interface 16 can include a variety of available microprocessors from 
with a computer application. Intel, AMD, Cyrix, Motorola, or other manufacturers. 

These and other advantages of the present invention will Microprocessor 16 can be single microprocessor chip, or can 

become apparent to those skilled in the art upon a reading of 60 include multiple primary and/or coprocessors. Microproces- 

the following specification of the invention and a study of *° x preferably retrieves and stores instructions and other 

the several figures of the drawing. necessary data from RAM and ROM, as is well known to 

nnTrr „ r ^ niwri/ , v , „, those skilled in the art. In the described embodiment, host 

BRIEF DESCRIPTION OF THE DRAWINGS computer system 12 can feceive locatjve daU or , sensof 

FIG. 1 is a block diagram of a system including a host 65 signal via a bus 24 from sensors of interface device 14 and 

computer and a force feedback interface device of the other information. Microprocessor 16 can receive data from 

present invention; bus 24 using I/O electronics 21, and can use I/O electronics 
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lo control other peripheral devices. Host computer system such as the Internet or a LAN; or, bus 24 can be a channel 

12 can also output a command to interface device 14 via bus such as the air, etc. for wireless communication. In another 

24 to cause force feedback for the interface device. Clock 18 embodiment, one or more additional buses can be included 

is a standard clock crystal or equivalent component used by to communicate between host computer system 12 and 

host computer system 12 to provide timing to electrical 5 interface device 14 for an increased data bandwidth, 

signals used by microprocessor 16 and other compooents of Interface device 14 includes a local microprocessor 26, 

the computer system. sensors 28, actuator 30, a user object 34, optional sensor 

Display screen 20 is coupled to host microprocessor 16 by interface 36, an optional actuator interface 38, and other 
suitable display drivers and can be used to display images optional input devices 39. Interface device 14 may also 
generated by host computer system 12 or other computer 10 include additional electronic components for communicat- 
systems. Display screen 20 can be a standard display screen, ing via standard protocols on bus 24. In the preferred 
CRT, flat-panel display, 3-D goggles, or any other visual embodiment, multiple interface devices 14 can be coupled to 
interface. In a described embodiment, display screen 20 a single host computer system 12 through bus 24 (or 
displays images of a simulation, game environment, oper- multiple buses 24) so that multiple users can simultaneously 
ating system application, etc. For example, images describ- ^ interface with the host application program (in a raulti- 
ing a point of view from a first-person perspective can be player game or simulation, for example). In addition, mul- 
displayed, as in a virtual reality simulation or game. Or, tiple players can interact in the host application program 
images describing a third- person isometric perspective of with multiple interface devices 14 using networked host 
objects, backgrounds, etc., or a 2-D image of a graphical computers 12, as is well known to those skilled in the art, 
user interface can be displayed. User 22 of the host computer 2 o Local microprocessor 26 can optionally be included 
12 and interface device 14 can receive visual feedback by within the housing of interface device 14 to allow efficient 
viewing display screen 20. Herein, computer 12 may be communication with other components of the interface 
referred as displaying computer or graphical "objects" or device. Processor 26 is considered local to interface device 
"entities". These computer objects are not physical objects, 14, where "local" herein refers to processor 26 being a 
but is a logical software unit collections of data and/or 2 5 separate microprocessor from any processors in host corn- 
procedures that may be displayed as images by computer 12 puter system 12. "Local" also preferably refers to processor 
on display screen 20, as is well known to those skilled in the 26 being dedicated to force feedback and sensor I/O of 
art. interface device 14, and preferably being closely coupled to 

Audio output device 21, such as speakers, is preferably sensors 28 and actuators 30, such as within the housing for 

coupled to host microprocessor 16 via amplifiers, filters, and 30 interface device or in a housing coupled closely to interface 

other circuitry well known to those skilled in the art. Host device 14. Microprocessor 26 can be provided with software 

processor 16 outputs signals to speakers 21 to provide sound instructions to wait for commands or requests from com- 

output to user 22 when an "audio event" occurs during the puter host 16, decode the command or request, and handle/ 

implementation of the host application program. Other types control input and output signals according to the command 

of peripherals can also be coupled to host processor 16, such 35 or request. In addition, processor 26 preferably operates 

as storage devices (hard disk drive, CD ROM drive, floppy independently of host computer 16 by reading sensor signals 

disk drive, etc.), printers, and other input and output devices. and calculating appropriate forces from those sensor signals, 

An interface device 14 is coupled to host computer system time signals, and stored or relayed instructions selected in 

12 by a bi-directional bus 24. The bi-directional bus sends accordance with a host command. Suitable microprocessors 

signals in either direction between host computer system 12 40 for use as local microprocessor 26 include the 

and the interface device. Herein, the term "bus" is intended MC68HC711E9 by Motorola, the PIC16C74 by Microchip, 

to generically refer to an interface such as between host and the 82930 AX by Intel Corp., for example. Micropro- 

computer 12 and microprocessor 26 which typically cessor 26 can include one microprocessor chip, or multiple 

includes one or more connecting wires, wireless connection, processors and/or co-processor chips. In other embodiments, 

or other connections and that can be implemented in a 45 microprocessor 26 can include digital signal processor 

variety of ways. In the preferred embodiment, bus 24 is a (DSP) capability. 

serial interface bus providing data according to a serial Microprocessor 26 can receive signals from sensors 28 

communication protocol. An interface port of host computer and provide signals to actuator 30 of the interface device 14 

system 12, such as an RS232 serial interface port, connects in accordance with instructions provided by host computer 

bus 24 to host computer system 12. Other standard serial 50 12 over bus 24. For example, in a local control embodiment, 

communication protocols can also be used in the serial host computer 12 provides high level supervisory commands 

interface and bus 24, such as RS-422, Universal Serial Bus to microprocessor 26 over bus 24, and microprocessor 26 

(USB), MIDI, or other protocols well known to those skilled manages low level force control loops lo sensors and the 

in the art. For example, the USB standard provides a actuator in accordance with the high level commands and 

relatively high speed serial interface that can provide force 55 independently of the host computer 18. This operation is 

feedback signals in the present invention with a high degree described in greater detail in U.S. Pat. Nos. 5,739,811 and 

of realism. An advantage of the microprocessor-enabled 5,734,373, both incorporated by reference herein. In the host 

local control of system 10 is that low-bandwidth serial control loop, force commands are output from the host 

communication signals can be used to interface with inter- computer to microprocessor 26 and instruct the micropro- 

face device 14, thus allowing a standard built-in serial 60 cessor to output a force or force sensation having specified 

interface of many computers to be used as bus 24. characteristics. The local microprocessor 26 reports data to 

Alternatively, a parallel port of host computer system 12 can the host computer, such as locative data that describes the 

be coupled to a parallel bus 24 and use a parallel protocol, position of the user object 34 in one or more provided 

such as SCSI or PC Parallel Printer Bus. Also, bus 24 can be degrees of freedom. The data can also describe the states of 

connected directly lo a data bus of host computer system 12 65 buttons 39 and safety switch 41. The host computer uses the 

using, for example, a plug-in card and slot or other access of data to update executed programs. In the local control loop, 

computer 12. Bus 24 can be implemented within a network actuator signals are provided from the microprocessor 26 to 
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actuator 30 and sensor signals are provided from the sensors along one or more primary degrees of freedom and provide 

28 and other input devices 39 to the microprocessor 26. signals to microprocessor 26 including information repre- 

Herein, the term "force sensation" refers to either a single sentative of those characteristics. Herein, the term "primary" 

force or a sequence of forces output by the actuators 30 degree of freedom or "primary" axis refers to the degrees of 

which provide a sensation to the user. For example, 5 freedom which arc sensed to control a graphical object or 

vibrations, a single jolt, or a spring force are all considered entity implemented by computer system 12. For example, 

force sensations. The microprocessor 26 can process input- the planar degrees of freedom ot a mouse or the two rotary 

ted sensor signals to determine appropriate output actuator degrees of freedom of a standard joystick are primary 

signals by following stored instructions. The force process degrees of freedom. A twisting third degree of freedom of 

can command distinct force sensations, such as vibrations, ^mc j oysl i cks can a iso be considered a primary degree of 

textures, jolts, or even simulated interactions between dis- freedom. Typically, a sensor 28 is provided for each primary 

played objects. The sensors 28 provide sensor signals to the degfee of ffeedom along which object 34 caQ 5e moved For 

microprocessor 26 indicating a position (or other example, in a joystick or mouse, each of sensors 28 senses 

information) of the user object in degrees of freedom. The the of the user object 34 in a degree of f ree dom of 

microprocessor may use the sensor signals m the local motion. Alternatively, a single compound sensor can be used 

determination of forces to be output on the user object, as l0 sense p 0sitiori or movement in multiple degrees of 

well as reporting locative data derived from the sensor freedom. An example of sensors suitable for several embodi- 

signals to the host computer. mcQls described herein are digital optical encoders, which 

In yet other embodiments, other hardware can be pro- sense the change in position of an object about a rotational 

vided locally to interface device 14 to provide functionality 2Q axis and provide digital signals indicative of the change in 

similar to microprocessor 26. For example, a hardware state position. A suitable optical ^ncoder is the "Softpot" from 

machine incorporating fixed logic can be used to provide ij.s. Digital of Vancouver, Wash. Linear optical encoders, 

signals to the actuator 30 and receive sensor signals from potentiometers, optical sensors, velocity sensors, aceelera- 

sensors 28, and to output force signals according to a tion sensors, strain gauge, or other types of sensors can also 

predefined sequence, algorithm, or process. Techniques for 25 be used, and either relative or absolute sensors can be 

implementing logic with desired functions in hardware are provided. 

well known to those skilled in the art. Such hardware can be Sensors 28 provide an electrical signal to an optional 
better suited to less complex force feedback devices, such as interface 36> which can be used to convert sensor 
the device of the present invention. signals l0 signals that can be i nterpreted by the micropro- 
In a different, host-controlled embodiment, host computer 30 ce ssor 26 and/or host computer system 12. For example, 
12 can provide low-level force commands over bus 24, sensor interface 36 can receive two phase-related signals 
which are directly transmitted to the actuator 30. Host fr om a sensor 28 and converts the two signals into another 
computer 12 thus directly controls and processes all signals pa j r Q f c \ oc k signals, which drive a bi-directional binary 
to and from the interface device 14, e.g. the host computer counter. The output of the binary counter is received by 
directly controls the forces output by actuator 30 and 35 microprocessor 26 as a binary number representing the 
directly receives sensor signals from sensors 28 and input angular position of the encoded shaft. Such circuits, or 
devices 39. This embodiment may be desirable to reduce the equivalent circuits, are well known to those skilled in the art; 
cost of the force feedback device yet further, since no local f or example, the Quadrature Chip LS7166 from Hewlett 
microprocessor 26 need be included. Furthermore, since Packard, California performs the functions described above, 
only one actuator 30 can be used with forces not provided in 40 if ana l 0 g sensors 28 are used, an analog to digital converter 
the primary sensed degrees of freedom, the local control of (ADC) can convert the analog signal to a digital signal that 
forces by microprocessor 26 may not be necessary in the ^ received by microprocessor 26 and/or host computer 
present invention to provide the desired quality of forces. system 12. Each sensor 28 can be provided with its own 
Local memory 27, such as RAM and/or ROM, is prefer- sensor interface, or one sensor interface may handle data 
ably coupled to microprocessor 26 in interface device 14 to 45 from multiple sensors. Alternately, microprocessor 26 can 
store instructions for microprocessor 26 and store temporary perform the sensor interface functions. The position value 
and other data. For example, force profiles can be stored in signals can be used by microprocessor 26 and are also sent 
memory 27, such as a sequence of stored force values that to host computer system 12 which updates the host appli- 
can be output by the microprocessor, or a look-up table of cation program and sends force control signals as appropri- 
force values to be output based on the current position of the 50 ate. In alternate embodiments, sensor signals from sensors 
user object. In addition, a local clock 29 can be coupled to 28 can be provided directly to host computer system 12 as 
the microprocessor 26 to provide timing data, similar to shown by bus 24', bypassing microprocessor 26. 
system clock 18 of host computer 12; the timing data might Actuator 30 transmits forces to user object 34 of the 
be required, for example, to compute forces output by interface device 14 in one or more directions along a 
actuators 30 (e.g., forces dependent on calculated velocities 55 non-primary degree of freedom in response to signals 
or other time dependent factors). In embodiments using the received from microprocessor 26. Actuator 30 can generally 
USB communication interface, timing data for microproccs- be of two types: an active actuator and a passive actuator, 
sor 26 can be alternatively retrieved from the USB signal. Active actuators include linear current control motors, step- 
in the preferred embodiment, sensors 28, actuator 30, and per motors, pneumatic/hydraulic active actuators, a torquer 
microprocessor 26, and other related electronic components 60 (motor with limited angular range), a voice coil actuators, 
are included in a housing for interface device 14, to which an d other types of actuators that transmit a force to move an 
user object 34 is directly or indirectly coupled. Alternatively, object. For example, an active actuator can drive a linear 
microprocessor 26 and/or other electronic components of shaft along a linear degree of freedom. Active transducers of 
interface device 14 can be provided in a separate housing the present invention are preferably bi-directional, meaning 
from user object 34, sensor 28, and actuator 30. 6 5 they can selectively transmit force along either direction of 
Sensors 28 senses the position, motion, and/or other a degree of freedom. For example, DC servo motors can 
characteristics of a user object 34 of the interface device 14 receive force control signals to control the direction and 
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magnitude of force that is produced on a shaft. A passive Power supply 40 can optionally be coupled to actuator 
actuator can also be used for actuator 30; such actuators interface 38 and/or actuator 30 to provide electrical power to 
include magnetic particle brakes, friction brakes, or the actuator. Power supply 40 can be included within the 
pneumatic/hydraulic passive actuators which can be ; *ed in housing of interface device 14, or be provided as a separate 
addition to or instead ot a motor tc generate a damping 5 component. Alternatively, if the USB or a similar commu- 
rcsistance or friction in a degree of motion. A preferred type nication protocol is used, interface device 14 and actuator 30 
of actuator for use in the present invention is a linear can draw power from the USB and thus have no need for 
magnetic actuator, such as a linear voice coil, linear voice power supply 40. Also, power from the USB can be stored 
magnet, or linear solenoid. Rotary actuators having output and regulated by interface device 14 and thus used when 
that is converted to linear force/motion can also be used. In 10 needed to drive actuators 30. For example, power can be 
the preferred embodiment of the present invention, actuator stored over time in a capacitor or battery and then iramedi- 
30 is provided to generate force approximately perpendicu- atcly dissipated to provide a jolt force to the user object 34. 
lar to the degrees of freedom of motion of the user manipu- Safety switch 41 is optionally included in interface device 
latable object 34, i.e., a force is transmitted along a "non- 14 to provide a mechanism to allow a user to deactivate 
primary" axis or degree of freedom of the user 15 actuator 30, or require a user to activate actuator 30, for 
manipulatable object that is approximately perpendicular to safety reasons. In the preferred embodiment, the user must 
the plane of motion of the user manipulatable object (if continually activate or close safety switch 41 during opera- 
planar motion is provided) or that is approximately radial to tion of interface device 14 to enable the actuator 30. If, at 
the sphere or circle of motion of the user manipulatable any time, the safety switch is deactivated (opened), power 
object (if spherical motion is provided). The actuator 30 can 2 o fr° m power supply 40 is cut to actuator 30 (or the actuator 
apply force .long the lengthwise ("in-line") axis of the user is otherwise disabled) as long as the safety switch is opened, 
object itself in the case of a joystick or stylus (FIGS. 3 and For example, one embodiment of safety switch is an optical 
6, below). Thus, the actuator 30 does not generate force in switch located on user object 34 or on a convenient surface 
the primary degrees of freedom of motion of the user object, of a housing of interface device 14. The switch is closed 
but instead provides "informative" or "effect" forces that do 2 s when the user covers the optical switch with a hand or finger, 
not resist or assist motion. These forces are preferably so that the actuator 30 will function as long as the user 
provided in an unsensed degree of freedom that is not used covers the switch. Safety switch 41 can also provide a signal 
to control a host-implemented graphical object/entity or directly to host computer 12. Other types of safety switches 
provide user-controlled data to the host computer. The 41 can be provided in other embodiments, such as an 
sensors 28 detect the position/motion of the user object 34 30 electrostatic contact switch, a button or trigger, a hand 
in its primary degrees of freedom, and this sensing is in no weight safety switch, etc. If the safety switch 41 is not 
way affected by the output of forces by actuator 30. This provided, or is coupled to the microprocessor, actuator 
configuration allows the actuator 30 to be included in force interface 38 can be directly coupled to actuator 30. 
feedback device 14 at much less cost, since only one User manipulable object 34 ("user object" or 
actuator 30 need be provided. Furthermore, in the preferred 35 "manipulandura") is a physical object, device or article that 
embodiments, actuator 30 is provided in a direct-drive may be grasped or otherwise contacted or controlled by a 
system, i.e. a system in which the actuator outputs forces user and which is coupled to interface device 14. By "grasp", 
directly to the user manipulatable object, where no trans- it is meant that users may releasably engage a grip portion 
mission system need be employed between actuator and user of the object in some fashion, such as by hand, with their 
object. This further reduces the cost of the force feedback 40 fingertips, or even orally in the case of handicapped persons, 
device since no complex transmission system need be manu- The user 22 can manipulate and move the object along 
factured and assembled in the device. Examples of embodi- provided degrees of freedom to interface with the host 
ments utilizing actuator 30 are described below. Alternate application program the user is viewing on display screen 
embodiments can employ additional actuators for providing 20. Object 34 can be a joystick, mouse, trackball, stylus, 
forces in the degrees of freedom of the user object 34. Other 45 steering wheel, sphere, medical instrument (laparoscope, 
alternate embodiments might employ an additional sensor to catheter, etc.), pool cue, hand grip, knob, button, or other 
sense motion of the user object (or portion of the user object) article. Also, additional mechanical structures may be 
that can move in the linear, non-primary degree of freedom. included in interface device 14 to provide object 34 with 

Actuator interface 38 can be optionally connected desired (primary) degrees of freedom. Examples of mecha- 

between actuator 30 and microprocessor 26. Interface 38 50 nismsare described in U.S. Pat. Nos. 5,731,804, 5,721,566, 

converts signals from microprocessor 26 into signals appro- 5,805,140, 5,825308, and 6,024,576 and application Ser. 

priate to drive actuator 30. Interface 38 can include power No. and 08/965,720, all incorporated by reference herein, 

amplifiers, switches, digital to analog controllers (DACs), FIG. 2 is a side sectional view of an example of a linear 

analog to digital controllers (ADCs), and other components, voice coil actuator 100 suitable for use with the present 

as is well known to those skilled in the art. In alternate 55 invention. Linear voice coil actuator 100 is a grounded 

embodiments, interface 38 circuitry can be provided within actuator and includes a cylindrical magnetic flux housing 

microprocessor 26, in actuator 30, or in host computer 12. 102 and a coil head 104. Housing 102 can be made of iron 

Other input devices 39 can optionally be included in or other ferrous metal and includes a radially polarized, 

interface device 14 and send input signals to microprocessor tubular magnet 106 (which, alternatively, can be made up of 

26 or to host processor 16. Such input devices can include 60 multiple, smaller magnets) positioned along the inside 

buttons, dials, switches, or other mechanisms. For example, length of the housing and which are radially magnetized. In 

in embodiments where user object 34 is a joystick, other addition, a core portion 108 of housing 102 preferably 

input devices can include one or more buttons provided, for extends down the center of housing 102 through the center 

example, on the joystick handle or base and used to supple- of coil head 104. The housing 102, bead 104, and core 

ment the input from the user to a game or simulation. The 65 portion 108 can be other than cylindrically-shaped in other 

operation of such input devices is well known to those embodiments; for example, rectilinear or other shapes can be 

skilled in the art. provided. 
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Coil head 104 includes a coil 110 which is wrapped 
around the coil head. An optional coil support 112 can be 
provided around which to wrap coil 110. The coil head 104 
moves within the housing 102 along a linear degree of 
freedom, indicated by arrows 114, when an electric current 
is flowed through coil 110. As is well known to those skilled 
in the art, the electric current in the coil generates a magnetic 
field. The magnetic field from the coil then interacts with the 
magnetic fields generated by magnet 106 to produce a force 
and a relative motion between coil head 104 and housing 
102 in a degree of freedom along axis A, as shown by arrows 
114. The magnitude or strength of the force is dependent on 
the magnitude of the current that is applied to the coil. 
Likewise, the direction of the force depends on the direction 
of the current in the coil. In other embodiments, the coil head 
104 can be made longer than the housing 102. Linear voice 
coil actuators are well known to those skilled in the art and 
are described in Precision Machine Design, by Alexander 
Slocum, Prentice Hall, 1992, page 64, and in U.S. Pat. No. 
58,805,140; which are both incorporated by reference 
herein. 

Thus, by applying a desired current magnitude and 
direction, force can be applied between the coil head 104 
and the housing 102. In some embodiments, housing 102 is 
grounded, and coil head 104 is biased to move (shown in 
FIG. 2); in other embodiments, coil head 104 can be 
grounded, and housing 102 is biased to move (whether 
actual movement of the head 104 or housing 102 occurs 
depends on whether an opposing force from the user or other 
source is applied to the moving portions, which may hinder 
or prevent movement). When the moving portion of the 
actuator moves away from the other portion, the actuator 
extends, and when the moving portion moves toward the 
other portion, the actuator contracts. A moving portion 116 
of user object 34 is coupled to the moving portion of the 
actuator 30, so that the moving portion 116 of the user object 
34 is moved by the force applied by the actuator. 

A spring 120 can optionally be included in actuator 100. 
For example, spring 120 can be coupled to the inside surface 
122 of coil head 104 and compress when the surface 122 
moves toward the inner core portion 108 of the housing 102. 
Spring 120 is provided to bias the actuator toward an 
extended position. This can be useful in some embodiments 
in which the actuator is desired to be in a non-compressed 
neutral position when no force is applied to the user object. 
For example, if the user object is coupled to coil head 104, 
the user object should have some distance along axis A to 
compress from a rest or neutral position. The spring 120 
biases the user object toward a neutral position near the 
center of the degree of freedom. Spring 120 can be a 
physical, mechanical spring or may be a "magnetic spring", 
i.e. a number of magnets that provide a repulsive magnetic 
field to cause a bias force toward a centered or neutral 
position. Alternatively, other types of springs can be used, 
such as air or other fluid compression with valves, etc. 

In other embodiments, different types of actuators can be 
used. For example, linear voice magnet, linear solenoid, DC 
current controlled linear motor, a linear stepper motor con- 
trolled with pulse width modulation of an applied voltage, a 
pneumatic/hydraulic actuator, a torquer (motor with limited 
angular range), etc. Also, passive actuators can be used, such 
as magnetic particle brakes or fluid -controlled passive actua- 
tors. In yet other embodiments, linear force and motion in 
the non-primary degree of freedom can be achieved through 
the use of a rotary actuator, e.g. a rotary actuator outputs a 
torque in a rotary degree of freedom on shaft, which is 
converted to linear force and motion through a transmission, 
as is well known to those skilled in the art. 
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FIG. 3 is a perspective view of a first embodiment 130 of 
a force feedback device 14 of the present invention. Force 
feedback device 130 includes a joystick base 132 and a 
joystick handle 134. Base 132 preferably includes most of 

5 the electrical components of the device 130, such as the 
microprocessor 26, sensors 28, sensor interface 36, power 
supply (if any), etc. Handle 134 preferably includes a base 
portion 136 and a grip portion 138. The base portion 136 is 
coupled to a mechanism (not shown) that allows the base 

10 portion 136 to move in two primary degrees of freedom, 
forward/back and left/right. Typically, these degrees of free- 
dom are rotational degrees of freedom, such as about axes X 
and Y, where the axis B extends through the length of 
joystick handle 134 is radial with respect to a spherical 

15 workspace of the joystick moving in the two rotary degrees 
of freedom, i.e. the joystick is moved as if on a portion of 
the surface of a sphere, where the axis B extends out of the 
surface of the sphere. The primary degrees of freedom of the 
joystick can be linear degrees of freedom in other embodi- 

20 ments. 

Actuator 30 is preferably coupled between the base por- 
tion 136 and the grip portion 138. With reference to the 
actuator 100 shown in FIG. 2, the base portion 136 can be 
coupled to the coil head 104 while the grip portion 138 can 

25 be coupled to the housing 102. Alternatively, the position of 
the housing and coil portions can be reversed. The grip 
portion 138 thus may be moved relative to the base portion 
136 due to the allowed movement of the coil head 104 with 
respect to the housing 102 of actuator 100. The amount of 

30 movement allowed depends on the dimensions of the actua- 
tor 100 used and any other factors such as stops provided to 
prohibit movement outside a particular range. Since the base 
portion 136 preferably cannot be moved along axis B, the 
base portion 136 is considered grounded with respect to the 

35 axis B. The microprocessor 26 can send signals to actuator 
100 to cause force to be applied in either direction in the 
(non-primary) degree of freedom of axis B, which may 
physically move the grip portion 138 along axis B if 
sufficient force is output (and if an active actuator is used for 

40 actuator 100). The grip portion 138 thus may extend or 
compress relative to the base portion 136. Buttons and 
switches 140 are typically provided to allow the user to input 
additional signals to the microprocessor 26 and host com- 
puter 18 (wires from any buttons on handle 134 can be 

45 routed through or around the actuator 100). In other 
embodiments, the size of the grip portion and base portion 
can be altered. For example, the base portion 136 can be 
made longer, while the grip portion 138 can be made shorted 
such that the user is grasping both portions when holding the 

50 joystick handle 134 in a normal fashion. 

Any number of different force sensations can be output on 
grip portion 138 using actuator 100. For example, a jolt 
sensation can be output, which is a single impulse of force 
that quickly rises to the desired magnitude and then is turned 

55 off or quickly decays back to zero or small magnitude. A 
vibration can also be output, which is a time-varying force 
that is typically periodic, e.g. a force vs. time waveform that 
is shaped like a sine wave, triangle wave, or sawtooth wave. 
The vibration causes the grip portion 138 to oscillate back 

60 and forth on axis B, and which can be output by the 
microprocessor to simulate a particular effect that is occur- 
ring in a host application. For example, the vibration can be 
output when a user-controlled racing car is driving on a dirt 
shoulder of a displayed road. A constant force can also be 

65 output on the user object. This is a force having a constant 
magnitude that is output for a specified period of time or 
until a condition occurs, such as a user-controlled cursor or 
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graphical object being moved to a predefined location in a For the user to feel the force output by actuator 100 

displayed graphical environment. effectively, the mouse 150 is provided with a housing 166 

Another type of force sensation that can be output by that includes two portions, a base portion 168 and a cover 

actuator 100 is a texture force. This type of force is similar portion 170. The base portion 168 is positioned approxi- 

to a repeating jolt force that depends on the position of the 5 mately parallel to the ground surface 156 and acts as the 

user object in its primary (sensed) degrees of freedom. For bottom of the mouse 150. The cover portion 170 is coupled 

example, a particular rectangular window area in a graphical to the base portion 168 by a hinge 172, where the cover 

user interface can be associated with a texture having bumps portion is not attached to the base portion at any location 

spaced at a predetermined distance apart over the area of the except for the hinge 172. Hinge 172 allows the cover portion 

window. As the joystick moves a cursor over the window J0 170 to rotate about axis D with respect to the base portion, 

and over each bump, a force impulse is output. This type of Thus, the end 174 of the cover portion can pivot away from 

force is spatially-dependent, i.e. a force is output depending the base portion 168 as shown by arrow 176. Hinge 172 can 

on the sensed position of the joystick as it moves over a be implemented in a variety of ways; for example, a 

designated textured area; when the joystick is positioned cylindrical, rotatable hinge can be provided; or, a flexible 

between "bumps" of the texture, no force is output, and 15 material can be provided between portions 170 and 168 to 

when the joystick moves over a bump, a force is output. allow the relative motion between the base and cover 

Other spatial force sensations can also be output. In addition, portions. Movable cover portion 170 can include the entire 

any of the described force sensations herein can be output by portion of the mouse contacted by the user in normal 

actuator 100 simultaneously or otherwise combined as operation, or can be a portion of the grasped area; for 

desired. Although these forces are not provided in the 20 example, the left and right sides of the mouse may be 

primary forward/back and left/right degrees of freedom of coupled to base portion 168 while only the top surface of the 

the joystick, the forces of the present invention can add to mouse is part of cover portion 170. The user's hand can 

the user's haptic experience of a computer environment in a grasp the sides of the mouse but a significant portion of the 

cost effective way. hand will rest on the cover portion 170 and thus feel any 

The spring 120 can also be included in or in conjunction 2 s forces output on the cover portion 170. 

with actuator 100, for example, to bias the grip portion 138 Actuator 100 is positioned between two members 162 and 

toward an extended rest position. This spring provides a 164 provided inside mouse 150, near the end of the mouse 

counterforce to the force applied to the grip portion by the opposite to hinge 172. Member 162 is rigidly coupled to 

user's hand, and allows the grip portion to be fully extended cover portion 170, and member 164 is rigidly coupled to 

and provide for a user's grip. 30 base portion 168. The coil portion 104 of actuator 100 can 

FIG. 4 is a side elevational view of a second embodiment be coupled to member 162, while the housing portion 102 of 

150 of a force feedback device 14 of the present invention. the actuator can be coupled to member 164 (these positions 

Device 150 is in the form of a mouse which is normally used can be reversed in alternate embodiments). This configura- 

by users to provide planar two-dimensional input to a tion allows the actuator 100 to output a linear force that 

computer system to control a cursor in a graphical environ- 35 moves the member 162 and cover portion 170 relative to the 

ment or alternatively to control a virtual character, vehicle, member 164 and base portion 168 about axis D. The actuator 

or other entity. Like most computer mice, mouse 150 can output a force in an up direction on axis C, thus causing 

includes a number of buttons 152 which are selected by the the cover portion 170 to move away from base portion 168; 

user when the user wishes to input a command gesture or the or a force in a down direction can be output, forcing the two 

like to the computer system. Mouse 150 also includes a 40 portions 170 and 168 closer together (if they are apart). The 

standard mouse ball 154 for providing directional input to actuator 100 can be placed near the rear of the mouse 150, 

the computer system. Ball 154 is a sphere that extends as shown, to cause the rear portion to move; or, the actuator 

partially out the bottom surface of the mouse and rolls in a 100 can be placed near the front of the mouse and the hinge 

direction corresponding to the motion of the mouse on a 172 at the rear to cause the front end of the mouse 150 to 

planar surface 156. For example, when the mouse 150 is 45 move. In some embodiments, the actuator 100 also includes 

moved in a direction indicated by arrow 158 (y direction), a physical spring 120 which biases the actuator to a partially- 

the ball rotates in place in a direction shown by arrow 160. or fully -extended position and thus prevents the cover 

The ball motion is tracked by a cylindrical roller 161 which portion from resting in a "compressed" position (in those 

is coupled to a sensor 28 for detecting the motion of the embodiments where the neutral or rest position of the cover 

mouse. A similar roller and sensor 28 is used for the 50 portion is at a position some distance above the base 

x-direction which is perpendicular to the y-axis. Other types portion). In an alternate embodiment, the actuator 30 can be 

of mechanisms for detecting planar motion of the mouse 150 a rotary actuator that outputs a rotational force (torque) on 

can be used in other embodiments; for example, a sensor can hinge 172 to cause rotary motion about axis D, thereby 

be built into the surface 156 to detect the position of an moving the cover portion 170 about axis D similarly to the 

emitter or transmitter in mouse 150 and thus detect the 55 linear actuator embodiment described above, 

position of the mouse 150 on the surface 156. The force sensations which can be output using actuator 

Mouse 150 of the present invention also preferably 100 can take a variety of forms. As discussed with respect 

includes actuator 100 for providing forces in a direction to FIG. 3, jolts and vibrations can be output when the 

along an axis C, which is approximately parallel to the microprocessor 26 or host computer 12 sends the appropri- 

z-axis. Axis C preferably extends approximately normal to 60 ate signals to the actuator 100. The jolts and vibrations can 

the planar surface 156 so that forces are provided perpen- indicate various features of the graphical environment on the 

dicularly to the plane of motion of the mouse 150. Actuator host computer to the user. For example, a vibration can be 

100 is preferably a linear electromagnetic actuator as output while a user-controlled cursor is positioned inside the 

described with reference to FIG. 2, but can be other types of boundary of an icon or other graphical object in a graphical 

actuators in other embodiments. Actuator 100 outputs a 65 user interface. The force is applied to the entire portion of 

force along axis C which causes motion in the same direc- the mouse grasped by the user, e.g. the entire cover portion 

tion along axis C. 170. Since the entire cover portion 170 may move or be 
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biased with the output force, rather than just a small area of 
the mouse's surface, the user's entire hand on mouse 150 
feels the jolt, vibration, constant force, or texture. 

The mouse embodiment 150 allows the user to interact 
with a graphical environment through the sense of feel. The 5 
output of forces can be coordinated with events occurring in 
the graphical environment. For example, when the user 
moves a cursor over a window in a graphical user interface, 
a jolt can be output by actuator 100 as the cursor moves over 
a boundary of the window. Furthermore, the magnitude of J0 
output forces can depend on the event in the graphical 
environment. For example, the force jolt can be a different 
magnitude of force depending on the type of graphical 
object encountered by the cursor. For example, a jolts of 
higher magnitude can be output when the cursor moves over 
windows, while jolts of lower magnitude can be output when 1S 
the cursor moves over icons. The magnitude of the jolts can 
also depend on other characteristics of graphical objects, 
such as an active window as distinguished a background 
window, file folder icons of different priorities designated by 
the user, icons for games as distinguished from icons for 20 
business applications, different menu items in a drop-down 
menu, etc. In games or simulations, the magnitude of jolts 
can be based on the severity of a collision or explosion, the 
size of the controlled graphical object or entity (and/or the 
size of a different graphical object/entity that is interacted 25 
with), the velocity or acceleration of the user object, etc. 
Similarly, different-magnitude vibrations can be output 
depending on the type of graphical object the cursor is 
moved over or depending on other characteristics of graphi- 
cal objects. Different magnitude constant forces can also be 30 
output depending on such characteristics. Finally, different 
magnitudes of textures and/or different spacings between the 
bumps of textures can be output depending on different 
characteristics of objects and entities encountered in the 
graphical environment. Different magnitudes of other force 35 
sensations can be similarly used. The above-described dif- 
ferences in force sensations can be applied to all the embodi- 
ments disclosed herein. 

The mouse embodiment 150 also allows the user to feel 
a simulated 3-D surface while moving the mouse in its 40 
planar workspace. For example, the user can be moving the 
mouse 150 on surface 156 to move a cursor or other 
user-controlled graphical object over a spatial "landscape" 
that is represented by an overhead view of the landscape on 
display screen 20. For example, a contour map can be 45 
displayed on the display device 20. As the cursor moves over 
a hill of the displayed landscape, the actuator 100 is con- 
trolled to output a force that moves the end of the mouse 150 
about axis D (or along axis C) by a specified distance that 
approximately corresponds to the height of the hill (or so 
outputs a force having a magnitude proportional to the 
height of the bill). When the cursor is moved over an area 
that is at a lower elevation, the actuator 100 is controlled to 
move the cover portion 170 of the mouse 150 down to a 
lower level. In this way, the user can both perceive elevation 55 
changes visually by the use of contour lines, and can 
experience the elevation changes through the sense of feel 
by the distance that cover portion 170 is moved in the 
non-primary degree of freedom. For visual maps that do not 
make elevation changes obvious, the forces output by actua- 60 
tor 100 can provide information to the user that is not easily 
available through other senses. The use of actuator 100 for 
providing motion in the non-primary degree of freedom for 
a simulated 3-D surface can also be used in connection with 
other applications, such as a CAD 3-D drawing, a game, or 65 
even to indicate information in a word processor or spread- 
sheet. 
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FIG. 5 is a perspective view of a third embodiment 200 of 
a force feedback device 14 of the present invention. Device 
200 includes a base 202 and a rotatable wheel 204 coupled 
to the base 202. Wheel device 200 is typically used in 
conjunction with graphical racing games or other games in 
which a vehicle is controlled by the player. Any portion of 
the rim of wheel 204 is typically grasped by the hands of the 
user to turn the wheel during such games. Sensor 28 is 
provided in base 202 to detect the rotational position or 
motion of wheel 204. In the described embodiment, actuator 
30 (shown as actuator 100) is provided between the wheel 
shaft 206 and the base 202. For example, the shaft 206 
coupled to wheel 204 can be coupled to the housing 102, 
while the base shaft 208 that is coupled to base 202 and 
sensor 28 is coupled to the coil head 104 of the actuator 100. 
Actuator 100 can output linear forces along axis E, which 
extends through the center of rotation of the wheel 204, 
approximately perpendicular to the plane of rotation of the 
wheel. 

Actuator 100 provides force sensations to the user grasp- 
ing wheel 204 similarly to the sensations described above 
with respect to the embodiments of FIGS. 3 and 4. For 
example, vibration or jolt forces can be output in the 
non-primary degree of freedom along axis E when the user 
is controlling a vehicle on a simulated bumpy road. Texture 
forces can be output along axis E, dependent on a simulated 
velocity and trajectory of a controlled vehicle. A spring 120 
can be provided in the actuator 100 to bias the wheel 204 to 
a resting position, similarly to the joystick of FIG. 3. As 
described above, if actuator 100 is the only actuator used in 
device 200 and no forces are output in the rotary degree of 
freedom of the wheel 204 about axis E, the cost of the device 
can be significantly reduced. 

FIG. 6 is a side elevational view of a stylus embodiment 
220 of the force feedback device of the present invention. 
The stylus 220 can be used as a pointing device to input 
coordinates to host computer 18. For example, the stylus 220 
can be used in conjunction with a tablet that detects the point 
of contact between the stylus and the tablet or the position 
of the stylus over the tablet. The coordinates of the point of 
contact can be provided to the host computer to control a 
graphical "pen" in a drawing program or to control a cursor, 
as is well known to those skilled in the art. Other stylus 
embodiments may use a sensor in the stylus for providing 
coordinates in some defined reference plane or volume, and 
thus no tablet may be required. Several embodiments of 
stylus devices are well known to those skilled in the art and 
can be used in the present invention. Preferably, the stylus 
for use with the present invention does not have a mechani- 
cal linkage coupled to it to sense its motion, although such 
a linkage can be used in alternate embodiments. 

Stylus 220 includes a body portion 222 and a tip portion 
224. The user may grasp the body portion 222 and write or 
point with the stylus like a normal pen-like instrument. 
Alternatively, the user can grip the stylus 220 at the tip 
portion 224 and/or at actuator 100. Actuator 30 (shown as 
actuator 100) couples the tip portion 224 with the body 
portion 222. As shown, the body portion 222 is coupled to 
the coil head 104 of the actuator 100, while the tip portion 
is coupled to the housing 102. These positions can be 
reversed in alternate embodiments. The body and tip por- 
tions thus may extend relative to each other, and the actuator 
100 can output force along the lengthwise axis F which 
extends along the length of the stylus 220. The actuator 100 
may also include spring 120 to bias the lip and body portions 
to an extended neutral position. In one embodiment, the 
force seasations output by actuator 100 can be made suffi- 



10/10/2003, EAST Version: 1.04.0000 



US 6,353,427 Bl 

17 18 

ciently low in magnitude to allow the power source for the What is claimed is: 

actuators to be placed inside the stylus 220. For example, 1. A method for providing force feedback using a force 

batteries can be provided to source power for actuator 100. feedback mouse device in communication with a host com- 

Alteraatively, a cord 226 or other transmission device can be puter system implementing a host application program, the 

used to supply power to actuator 100 from a separate power 5 method comprising: 

supply. sensing movement of said mouse in physical space in two 

Hie actuator 100 can be controlled to output the various de 8 rees of freedom with 10 3 S r .° und and 10 

force sensations described above when the user is using the 0U, P ut * n50r 5 « nals representative of said movement 

stylus. For example, vibrations, jolts, constant forces, or ™ ,h at least one » D50r - 531(1 '^degrees of freedom 

textures can be output when the user moves the stylus tip M being approximately within a single plane, said mouse 

over areas corresponding to particular regions in a graphical ,n ^ ,udin 8 amous ? housing havmg a cover P ort.on and 

user interface or other graphical environment. A 3-D land- a base portion wherein said cover port.on is movably 

scape similar to that described above for the mouse embodi- to ?f ld base P orUon b y at least one . mn 8 e . 3nd 

ment 150 can also be used with stylus 220, where areas of wherei " 531(1 contacls S3,d P ort ! on T*' 

higher elevation can correspond with the actuator 100 mov- « F alm °f a hand of 531(1 U5er - 53ld ^ ver Pf 0 " ,nclud - 

ing the body portion 222 away from the tip portion 224 for m 8 31 ,easI 3 P ortlon of 3 ,0 P surface of 5a,d mouse 

a distance corresponding to the amount of elevation. housing, and 

_ . ... - „ An outputting a linear output force on a housing of said 

HO. 7 is a side elevational view of an embodiment 240 • . i j* • 

r ,u .1 r irn- c ^ ua . *>Atx 7 mouse in a direction approximately perpendicular lo 

of the stylus 220 of MG. 6. The embodiment 240 includes n • , ■ . . _ „•„ |T „ tar * tw l noA m ^ tmt ^ 

. J , . , , , . ... 20 said single plane using a computer-controlled actuator 

a standard body portion 241 and a different stylus Up 242 ^ , . t „ ■* . . . . r , . „ 

L i . ... , . coupled to said mouse, said torce applied to a cover 

which includes a rotatab e ball 244, e.g. simitar to a ball used ion of said m bousi rested 0Q b said hand 

in a standard ball-point pen The ball 244 is positioned of ^ whefein ^ ^ ion h moved with 

between two supports 246 which hold the ball in place but (0 ^ baje jon 

allow the ball to rotate whde maintaining a constant spatial 2 A mcthod as rccitcd fa ^ 1 wherein 0Qe cnd f M y 

position. Next to the ball 244 is actuator 100, which is „„. „„„• • , . „„,. „ r . . ... . .... 

r , . , , ... , , , j. , ., cover portion is moved with respect to said base portion. 

h^^ri ^fwi^ stylus 240. In the embodiment shown, the 3. A method as recited in claim 1 wherein said cover 

head 104 is coupled to the stylus 240 while the housing 102 ion ^ f0talabl M {Q said base ion such thal 

is coupled only to the coil head 104. Abrake pad 248 is also ^ ^ -J ^ oximatel ^ totionally with 

coupled to the housing 102 of the actuator. 3Q fespect {Q ^ base portioQ 

When the user wishes to use the stylus normally, the user 4. A method as recited in claim 1 wherein said actuator is 

moves the tip of the pen across a surface. Since the ball 244 a linear actuator. 

is the only portion of the tip contacting the surface in typical 5. a method as recited in claim 1 wherein said output 
operation, this motion causes the ball 244 to roll to allow a force is correlated with a graphical representation displayed 
fluid motion of the stylus over the surface. The contact of the 35 by said host computer system, wherein a position of said 
ball with a tablet surface can be sensed by a sensor in the mouse housing in said plane corresponds with a position of 
tablet, for example. When a force sensation is to be output, a cursor displayed in said graphical representation, 
the actuator 100 is controlled to extend, i.e. the housing 102 6. A mcthod as recited in claim 5 wherein said output 
and brake pad 248 are commanded to move and contact the force is a jolt correlated with the interaction of said user- 
ball 244. This causes a resistance to the motion of the ball 40 controlled cursor with a graphical object displayed in a 
and can cause the ball to stop rolling. If the actuator 100 is graphical user interface. 

commanded to quickly move the brake pad 248 against the 7. A method as recited in claim 6 wherein said jolt is 

ball 244 with maximum force, ajoltlike effect is felt by the output with a magnitude dependent on a characteristic of 

user. If the brake pad Ls more gradually contacted with the said graphical object with which said cursor interacts, 

ball, the user may feel an increasing resistance or damping- 45 g. a method as recited in claim 7 wherein said charac- 

like effect. If the actuator is commanded to pulse so that the teristic of said graphical object is a type of said graphical 

brake pad 248 continuously is contacted with the ball 244 object, wherein said type includes one of an icon, a window, 

and then withdrawn at a high frequency, a vibration-like and a menu item. 

effect is felt by the user. In some embodiments, a solenoid 9. a method as recited in claim 5 wherein said graphical 

is a suitable low cost embodiment for actuator 100 in the 50 representation includes a representation of a 3-D area having 

embodiment 240 since the solenoid can be readily adapted m0 re than two elevations, and wherein said output force is 

to move the pad 248 against the ball 244. correlated with an elevation of a portion of said graphical 

While this invention has been described in terms of representation on which said cursor is displayed, 

several preferred embodiments, it is contemplated that 10. A method as recited in claim 1 wherein said force is 

alterations, permutations and equivalents thereof will 55 included in a force sensation, said force sensation being one 

become apparent to those skilled in the art upon a reading of of a jolt, vibration, constant force, and texture force, 

the specification and study of the drawings. For example, 11. A method as recited in claim 1 wherein a processor 

many different types of forces can be provided with the separate from said host computer and local to said mouse 

actuator of the present invention. Several different types of device receives force information from said host computer 

user manipulatable objects can be provided in the present 60 system and provides control signals to said actuator based at 

invention, not limited to the embodiments described herein. least in part on said force information. 

Furthermore, certain terminology has been used for the 12. A texture simulating mouse device in communication 

purposes of descriptive clarity, and not to limit the present with a host computer displaying a graphical environment, 

invention. It is therefore intended that the following the mouse device comprising: 

appended claims include all such alterations, permutations, 65 a mouse housing physically contacted by a user and 

and equivalents as fall within the true spirit and scope of the movable in physical space in at least two degrees of 

present invention. freedom with respect to a ground surface; 



10/10/2003, EAST Version: 1.04.0000 



US 6,353,427 Bl 



19 



at least one sensor operative to detect said movement of 
said mouse in physical space in two degrees of freedom 
with respect to said ground and to output sensor signals 
representative of said movement, said two degrees of 
freedom being approximately within a single plane, 5 
wherein said sensor signals are received by said host 
computer and used to position a cursor displayed in 
said graphical environment; and 

an actuator coupled to said mouse housing and operative 
to apply output forces in a direction approximately 10 
perpendicular to said single plane, said forces applied 
along an axis extending through said mouse to a cover 
portion of said mouse housing rested upon by said hand 
of said user such that said cover portion is moved with 
respect to said ground surface, wherein said output 15 
forces simulate a spatially-dependent texture when said 
cursor moves over a designated area in a graphical 
environment. 

13. A texture simulating mouse device as recited in claim 
12 wherein said forces output by said actuator are low-level 
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forces controlled locally by a processing device local to said 
mouse device and separate from said host computer. 

14. A texture simulating mouse device as recited in claim 
12 wherein said forces output by said actuator are high-level 
forces derived from a high-level command sent to said 
mouse device by said host computer, said high-level com- 
mand interpreted and implemented by a processing device 
local to said mouse device. 

15. A texture simulating mouse device as recited in claim 
12 wherein said mouse device is coupled to said host 
computer by a Universal Serial bus (USB) communication 
interface. 

16. A texture simulating mouse device as recited in claim 
12 wherein said cover portion of said mouse device moves 
as a result of receiving said forces, wherein said movement 
is not sensed by said mouse device. 

17. A texture simulating mouse device as recited in claim 
12 wherein said output forces are jolts correlated with 
locations provided in said designated area. 
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